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ABSTRACT _ 

A systematic study of the composition and 

dispersement of Title I projects assigned to elementary^ schools in 
Philadelphia was conducted. Categorical variables were identified 
from four major derived variables (program density code, school 
aggregate fund, pupil service component, achievement-growth 
differential score) and four major demographic variables (school 
staff, average daily attendance, per pupil and per teacner^ 
expenditures), content analysis of the four program densities 
revealed (a) that four distinct implementation patterns (models) 
existed and (b) that the thrust of each model was programmatically 
different . The four implementation models were identified as (1) 
Educational/Cultural Enrichment Experiences; (2) General 
Instructional and Supervisory Support System; (3) Intensive 
Instructional and Supervisory Support System; and (4) Remediation 
Programs. Assessment of Pupil outputs provided by each model 
indicated that although significant differences were present between 
the grades, the anticipated levels of output were not achieved. 
However, six rational procedural alternatives for increasing the 
capability of the schools to increase their achievement levels within 
each model are provided. Findings suggest that traditional evaluation 
techniques are not suitable for assessing the prograrnmatic effect of r 
or for developing operational management information about federal 
programs, (Author/AG) 
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A STUDY OF ESEA, TITLE I IMPACT COMPONENTS ON 
URBAN ELEMENTARY SCHOOLS AND THEIR PUPILS - ' 



Although past assessment of Title I program expenditures have 
demonstrated their importance at local and national levels, ^ administra- 
f tors are now being required to determine the total impact and cost— 
effectiveness of such expenditures — a process which requires more than 
estimates of the effects of program expenditures on a designated propor- 
tion of the pupils in the defined population. Instead, information is 
required which pertains to individual schools as well as the total target 
population of a school district. This concept of impact analysis seems 
to imply that expenditures should provide both direct and indirect effects. 
That is, systematic expenditures of monies within a fixed population 
should effect not only those pupils and teachers who participate directly 
in the program, but also others, who are experiencing like difficulties 
indirectly. To illustrate: The investment of projects in a school or 

school district should effect not only pupils in the particular grade (s) 
to which the projects have been assigned? it should also produce improve- 
ments in the overall achievement of that school, and the school district. 
Inherent in this assumption is the belief that when pupils are 
exposed to initial conditions which motivate them to perform better, they 
will continue to exhibit their newly acquired attitudes and improved 
achievement patterns in subsequent school years. This assumption also 
appears to be substantiated (a) by the sampling technique used in the 
national assessment of Title I and (b) by the emphases placed on program 
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concentration and comparability, and the delivery o£ Title I services 

o 

made in the 1971 Annual Report for the President and congress. National 
assessment sampling techniques stress the collection of pupil data using 
the school as a unit of observation rather than the pupil. The 1971 
Annual Rep ort defined (a) program concentration as a practice which places 
the greatest proportion of funds where the greatest need exists (p. 23) ; 

(b) program comparability as the assurance that the principles of conccn- 
tration and incentives result in equitable application of said funds 
(p, 23); and (c) the delivery of services as the dissemination of manage- 
ment information that would improve the delivery of such services to 
disadvantaged children (p. 24) . 

Managem ent Decision Levels 

Because of the concerns mentioned above, decisions pertaining 
to program funds by local education agencies (LEAs) are seldom unilateral. 
Three management levels are generally involved: strategic, operational, 

and instructional* Strategic management personnel are those who have 
the responsibility for making key policy decisions about the goals and 
directions of Title I, E8EA expenditures (e*g. , members of the Board of 
Education, Superintendent of Schools). The policies they enunciate set 
the operational parameters which insure (a) the attainment of needs- 
assessment goals and (b) the implementation of program elements to meet 
the identified needs* 

Operational management personnel are those in upper management 
levels who have the responsibility for translating the policy plans of 
strategic management into operational (implementation) practices. It is 
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they who surjply tha "flesh" ox- structures to the strategic plans and 



make them become a functional reality* These personnel interface with 



administrators and directors of essential divisions and/or departments 



who sustain the operations of the LEA* 



ins tr uc f ion a 1 man age mo n t personnel are those in middle manage- 



( 



ment levels who have the responsibility for defining* developing* and 
articulating specific- programmatic inputs (in the form of instructional 
methods, materials* and staff development) that would facilitate the 
realization of the strategic plans at the classroom level* The instruct 
tional projects they design contain behavioral and/or performance 
objectives that seek to improve the achievement of the pupils in the 
target population. 

The interactive relationships among these management levels* 
the resultant management actions corresponding to the appropriate level* 
and the assessment techniques used to produce requisite management infor- 
mation are presented in Figure 1* This figure shows (aj that at least 
three levels of management information are required to satisfy the needs 
of the LEA management personnel* and (b) that to date no system for 
assessing the impact of the implementation decisions of operational 
management exists* 

Implementation of Title I Projects 

In Philadelphia Title 1 program funds are realized as educational 
projects at the school level* These projects range from provisions for 
spealized projects (i.e., classes for mentally and emotionally disturbed 
children) to a wide variety of enrichment experiences ( e . g * * art* world 
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Figure 1 . interactive relationships among LEA management levels 




affairs clubs) * 



iBCiudGd in this rango of pio j octs is a number of projects 
designed to improve the pupils* performance in reading and arithmetic. In 
essence, the thrusts of the school district's expenditure of Title l program 
funds are directed toward the implementation of instructional and supportive 
services for the total development of its pupils. That is, to involve its 
pupils in a variety of activities which lead (a) to improved academic 
achievement , fb) to improved self -percept ion, (c) to increased social 
involvement, and (d_) to improved assessments of individual potentialities* 

In addition, parents and the Community are encouraged to participate in 
school-community programs and activities. 

Although these goals might seem to bo too general Or non-specific 
to produce meaningful pupil outputs, their programmatic inputs are directed 
toward the maintenance and/or control of school achievement variance. in 
his study of individual differences, Bloom‘d identified three major variables 
which could account for as much as 90% of the systematic variation observed 
in school achievement performance ; entry behavior, affective entry 
characteristics, quality of instruction. Table 1 shows the categorical 
partitions of partial and summative school variance, as defined by Bloom, 
and the corresponding programmatic Title i project components for the 
Philadelphia schools. 

This table gives the analogues drawn between the three major 
variables for controlling pupil performance (in elementary schools) 
identified by Bloom and three major Title I project components. The entry 
behavior characteristics in Bloom’s classification are equivalent to the 
aims, objectives, and treatment outcomes of Title I BAS project components. 
Both entry behaviors and BAS components, although not mutually inclusive 



Analogues Between Bloom’s Partition of School" Achievement Variance Variables 
and the Programmatic Input Components of Title I Projects 
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by current definitions, arc contiguous with (ay the learning readiness 
skills described by Ausubel 4 and Jensen, 5 and (b) the basic elements upon 
which the learning sets of Harlow 6 and Gagne 7 are constructed. 

The equivalence between affective entry characteristics and IQ 
project components appears to be more explicit than the previous condition 
in that the objectives of 10 project components are to create and/or 
develop the characteristics described by the affective entry behaviors. 

The quality of instr uction variable of Bloom and Title I SUP 
project components appear to be tautomeric. Bloom's definition of quality 
of instruction describes the desired outcomes of SUP components : (a^) to 

assist teachers in becoming more effective teachers and (b) to provide 
each classroom with a variety of multi-level and multi-modal materials 

to meet the individual needs of its pupils* 

Although the explanations given above show the relationships 

between the two systems for affecting school achievement variance, analyses 
to establish the actual proportions of variance attributable to Title 1 
project components have, as yet, not been conducted* However, if the 
analogies between the two universes are consistent, the proportions of 
explained variance derived by Bloom (probable limit of variation) represent 
the conditional limits or levels of impact Title I project components have 
on the output of the target populations. 

To illustrate the extent to which such combinations for control 
effects could exist within a school district, suppose one had a limited 
number of Title I projects (n=lQ) and a known population of schools (n=lQ) . 
Prom these numbers it is easy to see (a) that the universe of possible 
project combinations is extremely large (?_ Cb) and (b) that the probability 
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that any one subset of projects from this universe would appear in a 
given school is very small (£-1/2°). In addition, if a specific subset 
of projects from this universe were to occur at a frequency that exceeded 
its individual probability, then that subset of projects would not be a 
random occurrence, but a reflective index which describes the programmatic 
thrusts of the school district. If that subset of projects were a pre- 
scriptive input obtained from a needs-assessment of the pupils in the 
target population, then it represents a systematic resource input designed 
to ameliorate identified needs of the pupil population. Moreover, if a 
number of these subsets exists within a given population of schools and 
pupils, then no unitary measure should be used to assess the total success 
of the program input (treatment) systems on pupil output. In fact, it may 
be this phenomenon— the cumulative effects of intrinsic pupil and/or school 
p^QcfX’^xi'i input systems— which confound our efforts to measure the total 

g 

impact of such federal, programs. 

Current Evaluation Techniques 

The ability of current evaluation techniques to measure or assess 
the pupil outcomes of these kinds of programs has been the cornerstone of 
much discussion. 9/10,11,12,13 If . i n< j ee a f these techniques are not sensitive 
enough to measure the differential or incremental changes in pupil perform- 
ance produced by these kinds of programs, then it is quite possible that 
meaningful changes in pupil performance might have occurred in cases where 
no significant program effects were reported. 1 ^ 

The need to demonstrate the relationship between monies invested 
in education and pupil outcomes is paramount. In his discussion of 
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accountability, Lieberman ' concluded that since little positive evidence 
is available that proves that large investments of monies in education 
arc producing meaningful pupil outputs, the public and educators will 
begin to demand other alternatives for educations which may be more 
ineffective than the present system. 

( 

Although a wide variety of methods have been proposed for 
generating cost-effectiveness data, the acceptance and use of these methods 
by school systems have not been commensurate with their, and the public’s 
demand for such information. Currently, two general methods are being 
used to produce cost-effectiveness data. One method (program-planning^ 
budgeting system, PPBS) encourages the articulation of program or educa- 
tional objectives around which planned budgets are developed (a) prior 
to the implementation of the prescribed progrcims and (h) in advance of 
budgetary appropriations . 16 ' 17 ' 18 ' 19 The other method encourages the 
v use of regression analysis or simultaneous equations which are used to 
predict cost -ef f ectiveness or cost benefit indices . 21 ' 22 f 23 ' 

Although the two general methods mentioned are rigorous tech- 
niques for providing reliable cost information, the characteristics of 
the variables used in these assessment procedures, as well as the 
length of time that is required to establish them as key decision-making 
tools, preclude, their generalizabiiity and immediate implementation . 25 
Green 26 and Durstine 21 have suggested that pilot or exploratory studies 
be undertaken which produce prompt and useful information for school manage- 
ment in areas of their greatest concerns. Such endeavors, they concluded, 
would begin to demonstrate the usefulness of cost information in the decision 
making process. 
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One expressed area of concern by school (operational) management 
relates to the need for having a viable method for allocating and re- 
allocating personnel and material resources to produce improved pupil 
performance. However, because of the complex, intricate organizational 
( and instructional structures of an educational system, grandiose, broad- 
sweeping ^organizational plans for personnel and material resources over 
short periods of time are neither practical nor productive. Instead, 
school (operational) management must have information that permits them 
to propose and implement prudent, systematic changes to meet immediate 
and projected school district needs. 

The articulated concerns for appropriate change mechanisms and 
for a functional accountability system seem to imply that school (operational) 
management needs to have a program impact or accountability information 
system that produces reliable global information. That is, systematic 
information which demonstrates (a) the relationships between major areas 
of program inputs, (b) the interrelationships among their components, and 
(e ) the independent and combined effects of these components on desired 
pupi 1 ou to ome s . 



Statement of the Problem 

In Philadelphia there are 16 Title I projects which serve 63 
elementary schools having a kindergarten to grade six organization. These 
elementary schools have project component sets of varying combinations which 
contain from a minimum of one project to a maximum of eight projects. To 
quantify these levels of program input, a program density code (PD) was 
developed. Operationally, this code represents the magnitude of Title I 
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progx'am investment realized at the instructional management level of each 
elementary school. A listing of the 16 projects and the distribution of 
these project component sets, by level of program input, are shown in 
Table 2 on page 12* 

The evaluations of the individual .projects assigned to Title 1 
schools over the past three years have indicated that these projects are 
reaching their individualized objectives* In addition to the annual 
evaluation reports an historical document is kept on each project,* 
Although the Digest serves as a thesaurus of project information, the 
findings of the individual project's impact cannot be readily integrated 
into primary resource data for answering some of the broad, programmatic 
questions raised by operational management personnel* For example: 

Question L Have the placement of projects in the schools ad- 
dressed themselves to the production of instructional climates which are con- 
sistent with the needs of the pupils for whom they were designed to serve? 

Question 2. Have the placement of projects in the various 
schools created instructional or learning environments (a^) which motivate 
the pupils to learn and (b) which facilitate the development of classroom 
conditions which enable the teachers to improve their teaching practices? 

Question 3 * Have the implementation practices permitted the 
apportionment of the total Title I program funds info expenditure con- 
figurations which permit the realization of the desired pupil and teacher 
outcomes? 



As was shown in Figure 1, the project information obtained from 
the evaluation of individual projects provides only one piece of the total 



* Digest of ESEA, Title I Projects , Philadelphia: Department of 

Instructional Systems Research, Office of Research and Evaluation, School 
q District of Philadelphia, 1970* 
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TABLE 2 

Title I , ESEA Elementary School 
Projects (N-X6) 



Afro- -7 -lili e r 1 c a n Education Project (AEF) 
Art Specialist Teachers (AT) 

Closed Circuit Television '(CCTV) 
Computer-Ass is ted Instruction (CAT ) 
Counselor Aides (CA) 

Creative Dramatics (CD) 

Education in World Affairs (EWA) 

EIP Aides (EXP) 

English as a Second X^anguage (ESL) 
Improvement of Reading Skills (IRS) 
Instructional Materials Center (IMG) 
Kindergarten Aides and Supervisors (I<A) 
Learning Centers (LC) 

Music Sijecialist Teachers (MT) 
Paired-Schools Science Project (PSP) 
School Community Coordinators (SCC) 



Distribution of E5EA Title I Projects in 





Elementary 


Schools by Program Density 










Number of ESEA 




Program 




Title I Projects 


Total 


Density 




in a School® 




1 




1 or 2 


14 


2 




3 or 4 


14 


3 




5 or 6 


28 


4 




>JL 


14 




Total 




70 



®Only elementary schools with K— 6 organizations are included* 
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information required by operational management personnel * According to 
their defined responsibilities/ persons at this management level, make 
decisions concerning (1) the kinds of practices that should be implemented 
to achieve the policy goals of strategic management and (2) the allocation 
of Title I program funds, as individual projects, to respective schools 
within the target population. Therefore, an impact component analysis 
technique was developed to provide operational management with information 
about the feasibility and viability of their decisions. Specifically, 
the technique was designed? • 

1. To identify and describe the implementation patterns 
within the 63 elementary schools; 

2. To ascertain whether the impact components of the emerging 
implementation pattern are consistent with the needs-assessment of the 
pupil populations they were designed to serve; 

3. To produce service cost information which relates implement a- 
tion inputs to anticipated and/or attained pupil and school outputs; and 

4* To provide operational management with a number of alternative 
procedures for narrowing the discrepancy between desired pupil outputs and 
systematic program inputs. 

To test the hypotheses (1) that a limited number of Title I 
project component subsets exist for the elementary schools of Philadelphia 
and (2) that such project component subsets are indicative of systematic 
resource inputs to ameliorate identified pupil needs, a study of the 
composition and dispersement of 16 Title I projects (see Table 2) assigned 
to 63 elementary schools was conducted using the impact component analysis 
technique. 
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METHOD 



The derivation and development of the impact component analysis 
techniques follow the strategies of operations research (OR) , OR 
procedures emphasize the use of the scientific method to discover the 
causes for a phenomenon rather than the application of existing techniques. 
OR procedures also lead fa) to the articulation of theories for explaining 
the observed characteristics of the operation and (b) to the production of 
alternative procedures , practices, or policies for the system under 
investigation. OR analyses, therefore, stress the reduction of complex 
and involved systems or problems into a series of simple components which 

i * OQ 

may be described, observed, and quantif red . * 

Macleod, reporting on a successful method for adapting program 
budgeting techniques to nonprofit institutions, also stressed the need to 
define the activities of the institution. He found it necessary (a) to 
categorize the various levels of the institution's internal and external 
services and (b) to ascertain how much personnel time was being allocated 
to the specified services before he could reasonably apply the principles 
of program budgeting. From these estimates, he was able to develop cost 
data which improved his planning and reporting activities, as well as the 
reallocation of the institution's services. 

Block, 31 describing a new method of project control “Accomplish- 
mont/Cost Procedure (ACP) ,- appeared to have taken an OR approach similar 
to that advocated by the author. In constructing his method, he chose four 
comprehensive areas as being indicative of the functions of the organiza^ 
tions studied: (1) unique events , activities in which major work tasks 



are independent? (2) repetitive events , activities with similar work tasks; 
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(3) material, acquisition of materials used in the finished products; 
and (4) summar y , a process of integrating the preceding areas into a 
simple category (p. 114) _ These procedures permitted him to compare 

cost/progress relationship budgeted with cost/progress relationship 
expended for the tasks , thereby producing useful project control in- 
formation for all levels of project management (p* 111) - 

Systematic Input/Out put Variables -Associated with 
Title X Elementary Schools 

P u p i 1 Service Components (PSCs) 

To characterise the programmatic resource inputs provided by 
the Title I projects, three pupil service component (PSC) categories have 
been identified: (1) basic skills, BAS, , (2) instructional, other (than 

BAS)., IO, and (3) supportive services, SUB * The relationship between 
these PSCs (the treatment effects) and the contribution they provide 
toward the reduction of school and pupil performance variance has been 
discussed previously in Table 1* 

Allocation of Funds 

To partition and prorate to each Title I school that proportion 

of the total program fund which if receives in the form of projects, an 

32 

adaptation of the Belmont System (OE Form 4484, CPXR, 1970) was used* 

In this technique, the total budget allocated for each project was divided 
by the number of schools it served* This cost/school index was obtained 
for each project listed in the Federal Program Budget, FY 1969-1970** 

Since each school's projects were enumerated, aggregate monies per school 




*1969-1970 
Federal Programs 



Applications, Title X ESEA. Philadelphia: 
, School District of Philadelphia. 

IS 



Office of 
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v;era obtained by totaling those project fund proportionalities located 
in each school. The sum of monies available to the schools through this 
proration procedure was operational 3,y defined as its school aggregate fund 
( SAf ) , The me an SAFs for the schools in each program density classifica** 
tion are presented in Table 3, 



Mean School Expenditure by Program Density 





Program Density 






Proration 1 


2 


3 


4 


Total 


Aggregate Fund a $6,2 

Number of Schools 10 


$25,9 

11 


$38.6 

26 


$50.2 

15 


$39.9 

63 


^Figures given in thousands 


of dollars. 








Achievement-Growth Differential 


(AGD) 








For this study, grades 


3 through 6 


were 


chosen as 


the target 


years — that interval of schooling over which 


most 


inner-city 


pupils begin 



to fall dramatically behind national expectations.^ To describe and 
quantify the effects of a school’s instructional program on its pupils 
and to measure the impact of the school on its pupil 1 s educational progress 
over this interval, each school was assumed to have been organized around 
administrative and instructional practices which tended to sustain its 
functional capacity. In operations research terms, the assumption means 
that pupils are homogeneous with respect to the impact of a school * s 
instructional program, 1 . e. , pupils at each level are exposed to the 
” fixed-condi tions M of the school. Consequently, as pupils move through 
levels within a school, the instructional or educational experiences in 
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which the pupils participate are (a) pre-defined, (b) constant in content, 

(c) perennial in preparation and presentation, and (cl) managed through 
processes and/or procedures articulated by the administrator and teachers 
of that school. One expects, then, that if the instructional programs 
provided by a school were effective, its pupils, on the average, would 
gain three years of academic knowledge between grades 3 to 6 or that 
standardized measures of achievement would show an acquired knowledge 
differential of 3*0 GEY. 

To obtain an estimate of the achievement-growth patterns across 
grades 3 to 6 in each school, differences between the mean grade scores 
in each school wore obtained using the following formula: 

X school , grade 6 - X school^, grade 3 - achievement-growth 
Therefore , zero, positive, or negative values could be evidenced, which 
would represent the impact of a school’s learning environment on its pupils 
over grades 3 through 6* 

Considering the highest and lowest possible score a pupil could 
receive on a standard test at grades 3 and 6, the range of possible achieve- 
ment-growth scores was obtained, which defines a continuum upon which 
derived scores may be compared. The term, achievement-growth dif ferential 
(AGP) score, therefore, describes the achievement propensity of an 
elementary school. In this study AGDs have values within the interval 
-2.9 £ AGD £ +8,1.* 

*Xn cognizance of the issue of the comparability of the two groups 
and in recognition of the scalar differences between the distributions of 
the samples, APG is operationally defined as a mean estimate of differential 
achievement growth— that is, the extent to which the educational organiza- 
tion and instruction of a school moved its population of pupils along a 
hypothetical achievement— growth curve predicted by the continuum of the 
psychological constructs of the test instrument. 
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Av or ago nail A t t en cl a nee ( ADA ) 

This measure of joupil attendance v?as chosen over total enroll- 
ment because it is a count of the number of children (ja) who attend 
school on a regular basis and (b) who are exposed to the school’s educative 
activities on a continuous basis. 

Per Pup il an d Per Teacher Expenditures (PPE and PTE) 

These two cost expenditures were not obtained in the traditional 
manner — dividing the total Title X program fund monies by the number of 
children in the program. They were obtained on a school— by^school basis, 
using each school's SAP , ADA, and total teacher staff counts: 

( a ) ppe = SAF/ADA; (b) PTE SAF/numher of Teachers 

This method was used to ascertain whether systematic differences in these 
expenditures existed across the elementary schools. 

The procedure described above considers the school as the unit 
of observation and analysis. It also assumes that any program fund 
placed in a school effects the entire staff and pupil population of that 
school t because of the changes in school management and instructional 
practices that occur as a result of the investment. However, within each 
school there exists a differential program-input gradient which results in 
conditions (a) where the greatest concentration of program funds (projects)^ 
exists at those grades where the greatest pupil need are located and (b) 
where the residual and/or spin-off effects of the program inputs provide 
increasing benefits for the remainder of the school's staff and pupils . 



per Pupil Instructional Service Expenditure (FBI3) 

A term used to indicate the basal amount each pupil receives 
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from the general operating budget for instructional services^ 4 However, 
this* figure does not include supportive materials and personnel costs. 



Summative Per Pupil Expenditure (SPPE) 

A term used to indicate the total per pupil expenditures 
( provided for general instructional services and Title X program funds 
inputs: SPPE - PPXS 4* PPE (Title I). A listing of the variables pre- 

viously described appears in Table 4* 

Analysis 

The first level of analysis was performed in this study (aj to 
determine the reliability of the impact component analysis modal , (bO to 
obtain a demographic picture of the project implementation characteristics, 
and (e) to determine whether particular program input subsets existed within 
the elementary schools. The second level of analysis, contingent upon the 
identification of particular input program subsets, was used, to identify, 
explain, and document the implementation model (s) or strategies developed 
through the decisions and directions of the operational management* 

Level 1- To obtain a composite picture of the 63 Title I 
elementary schools along the dimensions of the variables used in the study, 
basic techniques were used to obtain the mean, median, and range of each 
variables* As a measure of the construct validity of the proposed impact 
component technique, an intercorrelation matrix was obtained and studied 
to determine whether the interrelationships among the defined variables 
corresponded to the known relationships between the financial, demographic, 
and population descriptors of the school district. To ascertain whether 
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TABLE 4 

A Li sting of the Dependent and Independent 
Variables Used in the Study 



Variable 

Number Description Acronym 



1 


School Enrollment 


SE 


2 


Average Daily Attendance 


ADA 




Pupil Population Characteristics 


PPG 


3 


IjOW Income 


PPC-1 


4 


Spanish-Speaking 


PFC-2 


5 


Blacks 


PPG- 3 


6 


Teacher Staff 


TS 




Achievement Growth Differential 


AGD 


7 


Reading 


AGD“R 


8 


Arithmetic 


AGD- A 


9 


Program Density Code 


PDC 




Pupil Service Components 


psc 


10 


Basic Skills 


PSC-l 


11 


Instructional, Other 


PSC-2 


12 ' 


Supportive Services 


PSC-3 




School Aggregate Fund 


SAF 


13 


Basic Skills 


SAF-1 


14 


Instructional , Other 


SAF-2 


15 


Supportive Services 


SAF- 3 


16 


Total 


SAF— 4 


17 


Per Pupil Expenditure 


PPE 


18 


Per Teacher Expenditure 


PTE 


19 


Per Pupil Instructional Service 


PPXS 


20 


Suminative Per Pupil Expenditure 


SPPE 




School Achievement Gain 


SAG 


21 


1968-1969: Reading AGD 


SAG-1 


22 


Arithmetic AGD 


SAG-2 


23 


1969-197 0 : Reading AGD 


SAG- 3 


24 


Arithmetic AGD 


SAG-4 
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unique project input subsets existed within the 24 variables used to define 
the programmatic implementation patterns created by the decisions of the 
operational management personnel, a factor analysis procedure (BMD 03R) 
was used, where the highest correlation value of each variable was used 
as its commonality. 

Level 2. Having identified the least number of program input 
subsets, a content analysis procedure was used to ascertain the program- 
matic thrust of each subset. This procedure consisted of the merging of 
the individual content (i.e., objectives, treatment (s) , materials, 
strategies) of each project within a subset into a comprehensive or 
summative descriptor. Accordingly, demographic and statistical data 
were developed for each subset. To determine whether significant differ- 
ences existed between the subsets on each variable, a series of one-way 
analysis of variance were performed. 

To ascertain whether the programmatic inputs of each subset 
produced a differential, aggregate and/or individual grade effect on pupil 
performance in reading and arithmetic, a 20% systematic sample* of pupils, 
within the Title I elementary schools of the subsets and within non-Title I 
schools, was obtained for analysis. One-way analysis of variances were 
performed on the aggregate and individual grade data to determine whether 
significant differences in performances scores existed. 

Program input /pupil output schemata were developed for each 
subset to determine whether the programmatic inputs for each grade, as 
well as for the three— year-period studied, differed significantly from 
subset to subset. An assessment of the relationship between the program— 

*Pupil History File, Division of Administrative and Survey Research, 
Office of Research and Evaluation, School District of Philadelphia. 
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inputs and the needs— assessment of ths pupils within the individual 
subsets was performed, The purpose of this analysis was to ascertain 
whether the proportion of pupils achieving the desired level of performance 
(output) were consistent with the configuration of PSC funds made available 
to the schools. A similar technique was used to determine whether the PSC 
configurations of the subsets were parallel to the school achievement 
control patterns described by Bloom. 
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results and interpretations 



Level 1 



Demographic and Statistical Data 



The median school in the sample of schools used in the study 



had the following characteristics: 



Composite Profile of the Median Title I Elementary School 



School Enrollment 


* 


750 


Average Daily Attendance 
No. Black 

No, Spanish Surname 

No, White 

Low income (185) 


625 

18 

107 

24,7% 


700 


Teacher Staff 




26 


School Aggregate Fund 




$33,800 a 


Basic Skills 
Instructional Other 
Supportive Services 


$18/000 

9,800 

15,800 




Per Capita Expenditures 






Teacher 

Pupil , Title I 

Pupil f Instructional Services 
Pupil, Summative^ 




$1,000 

30 

450 

495 



Pupil Service Component (5 Projects) 

1 Basic Skills Project 

2 Instructional Other Projects 
2 Supportive Service Projects 

Achievement-Growth Differential Scores 

Reading = 1.9 GE years in 3,0 school years 
Arithmetic - 2.0 GE years in 3.0 school years 



a Sum of categories is greater than aggregate , since each subcategory 
was treated as an independent variable. 

^Includes only general operating and Title I funds. 
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A more detailed treatment of each variable appears in Table 5. 



Cpp* 25-26) . 



Construct Validity Data 

One of the most important responsibilities of a proposed model 
is to demonstrate that the key indicators and program descriptors used 
to define it can be used to describe, with a high degree of accuracy, 
the actual conditions of the system for which it has been designed to 
represent. In this study, all of the key indicators and program descrip- 
tors were analyzed by a correlation procedure to ascertain whether the 
resultant correlation values among the 24 variables represented observed 
(known) relationships that exist within the School District — especially 
in its allocations for instructional staff, Title I program funds, and 
pupil achievement. 

Three subsets from the intercorrelation matrix of the 24 
variables (see Appendix A) are presented to illustrate the interrelation- 
ships identified among the key variables themselves and within the 
contextual framework of the proposed model. 

Major and minor variables . Since school enrollment (SB) is 
one variable used in the appropriation of instructional staff, program 
funds and materials, a listing of its correlation with eight other minor 
variables is presented below. 



Maj or 


Minor Variable 


Variable 


ADA 


T5 


SAF-4 


PPC-1 


PPX3 


SPPE 


PPE 


PTE 


SE 


87* 


88* 


27** 


68* 


-61* 


-65* 


-46* 


-41* 



*P < .01 
**p < .05 



This listing shows (aU that all correlation pairs, with the exception of 
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TABLE 5 

Demographic and Statistical Characteristics of 63 
Title I Elementary Schools 



Variable 



No* Schools * 

Having 

Variable Median Range 



School Aggregate Fund 



Total 


63 


33, 8 a 


9.4 





85 * i a 


BAS 


33 


18.0 


9.8 


- 


59*3 


IQ 


58 


9,8 


1.2 


- 


20*4 


SUP 


56 


15,8 


5.8 


— 


22.0 


School 


Population 


Characteristics 








School Enrollment 


63 


750 


188 


_ 


1,546 


Average Daily Attendance 


63 


700 


155 


- 


1,435 


No. Teachers 


63 


26 


8 


- 


47 


No, Low income 


63 


185 


27 


- 


1,043 


No. Spanish Speaking 


46 


18 


1 


* 


590 


No, Black 


63 


625 


2 




1,546 



Per Capita Expenditures 



Pupil 


63 


$ 30 


$ 10 - 


252 


Teacher 


63 


1,000 


400 * 


4,880 


Instructional Services^ 


63 


450 


357 - 


660 


Summative c 


63 


495 


386 - 


794 



a ln thousand of dollars, 

^Allocation from general operating budget, 
c General operating budget and Title I funds. 
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TABLE 5 (CONT, ) 

Demographic and Statistical Characteristics of 63 
Title I Elementary Schools 



pupil Service Components 





BAS 


ID 


SUP 


No, 


No. 




NO. 




No, 




Pro j ects 


Schools 


% of 


Schools 


% of 


Schools 


% of 




Having 


Sample 


Having 


Sample 


Having 


Sample 


0 


29 


46 


1 


2 


6 


10 


1 


31 


49 


12 


19 


14 


22 


2 


2 


3 


14 


22 


39 


62 


3 


1 


2 


22 


35 


4 


6 


4 i 






11 


17 






5 






3 


5 






6 














Total i 


63 


100 


63 


100 


63 


100 


I 








^ . . L, 





Achievement-Growth Differential 





Reading 


Arithmetic 


School year X969-1970 a 
range 


1.90 GEY b 
0.1 - 3.1 


1.98 GEY 
1,3 - 3.2 



a Median difference between mean scores of grade six and grade three 
pupils . 

^GEY “ grade equivalent years. 
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total school aggregate fund (SAF-4) , were highly significant (p < .01) and 
(b) that the relationsnips of SE with per capita expenditures were all 
negative* 

As expected, the two highest correlations with SE were average 
daily attendance (ADA, r = .87) and teacher staff (TS, r ™ *88) , followed 
by its relationship with children from low income families (PFC-1, r — .68). 
The negative relationships of SE with per capita expenditures were not 
anticipated and might have resulted as a phenomenon of standardized alloca- 



tion procedures* 

Allocation predictors . Eleven variables, which generally appear 
in allocation prediction formulae, were extracted from the primary inters 
correlation matrix* These variables, and their accompanying correlation 
pairs, appear in Table 6. Of the 55 correlation pairs, 22 were significant 



try m ^ nnVi« Vii'rrV.^ 

'.cr * - ’ i - — **^wj* — 



^ ^ ^ ^ n vi -J 

tu ^ **■ fc tiiy-j 



teacher (PTE) with per pupil. Title I (PPE) and Instructional Services 
(PPIS), 



TABLE 6 



Intercorrelation Matrix of Common Allocation Predictors 



Variable 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 | 


ii 


1. AGD-R 

2 . AGD-A 
3 * SE 

4 . ADA 

5. PPIS 

6. PPE 

7 . SAG-1 

8. SAG- 2 

9 . SAG- 3 

IQ. SAG-4 
11 PTE 


77* 

14 

16 

-06 

-36* 

09 

-06 

49* 

40* 

-42* 


-04 

-05 

04 

-01 

00 

03 

46* 

50* 

-09 


87* 

-61 

-46* 

-06 

-14 

10 

16 

-41* 


-58* 

-51* 

-12 

-19 

10 

-15 

-45* 


38* 

1,9 

25 

13 

23 

9i*| 


06 

33* 

-12 

18 

96* 


57* 

31* 

32* 

00 


14 

40* 

24 


52* 

-15 


10 





*p < .01 
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Expected significant positive correlations were those between 
(a) AGD-R and AGD-A, (b) ADA and SE, (c) PPE and FPXS, (d) SAG -2 and PPE, 

(e) between all SAGs, (f) between all- AGDs , and (q) between all SAGs and 
AGDs , 

A significant negative correlation was expected between AGDs 

and PPE, since specific plans were made to place the larger proportions 

of Title I funds in those schools having, the lowest levels of achievement . 

(The other two significant negative correlations with PPE were reported 

* 

in the previous section. ) Of the three other significant negative correla- 
tions with PTE, the one between if and achievement-growth differential in 



reading (AGD-R) was not anticipated. 

It should be noted that the relationship between per capita 



expenditures for instructional services from the general operating budget 



and school aci 



Uili 



JL11 t J. -i_ 



ithrn^tr^ , 






(SAG-2, SAG-4) , as well as PTE and SAG-4, were significant to a lesser 



degree (p < , 05 ) , 

Program Density’ Code. The correlations between one of the key 



variables of the proposed model, Program Density Code (PPC ) f and 14 other 
systematic variables are presented in Table 7. Of the 14 variables identi- 
fied below, eight were significant (p < .01) 

TABLE 7 

Interrelationships Between the Construct "Program Density Code 1 ' 

and 14 Systematic Variables 



Major 

Variable Minor Variable 











iH 












P4 




H 


cs 


cn 


Program 








1 

o 


i 

Pm 


pq 


pq 


L0 

M 


w 

CM 


i 

Q 


1 

Q 


1 

U 


i 

u 


I 

u 


Density 

Code 

(PDC) 


CO 


Q 


CO 

EM 


Oi 

CM 


3 

VI 


CM 


L-i 

CM 


P-i 

Qa 


CM 

m 




O 

< 


LQ 


CO 

p^ 


CO 

ft 


23 


15 


24 


46* 


78* 


47* 


56* 


-13 


12 


-37* 


-21 


66* 


82* 


74* 



2S 
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As hypothesised, PDC ' s interrelationships with the other 



variables provided evidence that the construct was defining the program- 
matic inputs of Title I program funds at the elementary school level. 

First, the significant positive correlation of PDC with the within-pupil 
service components (PSCs) and their implementation procedures, and its 
high correlation with the total funds available to the schools (SAF-4), 
seemed to substantiate the validity of the construct. Second , PDC appeared 
to be a construct which demonstrated the equivalency between Title I 
program expenditures as an aggregate fund and Title I as a iteration of 
per capita denotations (viz., PPE and PTE). Moreover, the construct 
provided confirmatory evidence that per pupil expenditures from the two 



major budget sources (e.g., PPIS and SAF-4) were the product of two 
independent allocation functions. The small negative value (r = -.13) 
between PDC and PPIS was considered to be the residual commonality 
(background effect) inherent in the relationships among the source 



variables - 

Third, the negative correlation values of PDC with the AGDs 
was to be expected in that the greater concentration of pupil service 
components (projects) exists in schools where the level of pupil achieve— 
ment was at its lowest. Fourth f although a significant relationship 
exists between PDC and children of low income families (PPC-1) , two other 
demographic variables (school enrollment, 3E and teacher staff, TS) were 
also related, to a lesser degree (p *05) • 

Factor Analysis Data 

To ascertain whether the intercorrelation patterns discussed in 
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the previous sections were indicative of some unique factors operating 
within the context of the variables used to describe the input/output 
characteristics of the Title I program funding policies and practices for 
elementary schools in Philadelphia, a factor analysis was performed using 
the correlation data of the 24 variables* A standardized program (bmd Q3r) 
was used, where the highest correlation values among the variables were 
used as the commonalities. Using the Kaiser criterion for the identifying 
meaningful factor roots (viz., vectors having eigenvalues > +1.0), six 
factors were identified and rotated orthogonally. The results of the 
rotation procedures produced six definable factors, where variables 
having loadings of > .30000 were considered to be relevant contributors 
to the factors. The six factors are shown in Table 8 on page 31. 

Anticipated factors. At the outset, three factors were antici- 
pated. These factors were related to three pre-existent, well-defined 
procedures and/or conditions: 1) a factor consisting of variables 

associated with the criterion predictors of general allocation formulae? 

2) a factor of the achievement measures; and 3) a factor demonstrating 
the correspondence between the PECs and their independent and sununative 
costs (SAF categories) . These factors did appear and were named accord- 
ingly: Factor I, Prediction Formula Criterion; Factor III, School 

Achievement Measurement; Factor IV, Direct Pupil Service Components. 

(See Table 8) 

Unique factors . One major and two minor unique factors were 
also identified. The unique major factor. Factor II s Program Density 
Expenditure Functions, was identified as that factor which included all 
of the key variables and descriptors utilised in the formulation of the 
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Significant Data Factors 





FACTOR Is 
Formula 


Prediction 

Criterion 


FACTOR II: Program Density 

Expenditure Functions 


Variable 


7 ' - 

{ Loading 


Variable 


Loading 


1. 


SE 


j 92667 


10. 


PSC-1 


94842 


6. 


TS 


! 90662 


16, 


8AF-2 


88885 


2. 


ADA 


88289 


9. 


PDC 


64523 


20. 


SFPE 


| -78177 


18, 


PTE j 


63424 


5, 


PPC-3 


77968 


12. 


P3C-3 i 


60106 


19. 


PPIS 


-66057 


17 * 


PPE i 

j 


58414 


18. 


PPE 


j “65897 


15. 


SAF-3 


56103 


18 , 


PTE 


| "60941 


13. 


SAF-1 


50387 


3. 


PPC-1 


59884 


3, 


PPC-1 


47197 


13 * 


SAF-1 


33814 


5, 


PPC-3 


34829 






i 


7. 


AGD-R 


“30431 








11. 


P3C-2 


30333 



i 

FACTOR Ills School Achievement j FACTOR V: General Disadvantaged 

Measurement j Service Expenditure 



a. 


AGD-A 


! 88016 


4. 


PPC-2 






-62802 


7. 


AGD-R 


j 82422 


19. 


PPIS 






39830 


W 

* 


SAG-4 


59302 


13, 


SAF-1 




i 


38123 


23. 


SAG-3 


* 58763 

j 


5, 


PPC-3 




i 


30105 


FACTOR IV s 


Direct Pupil 


FACTOR VI: 


School 


Investment 




Service 


Components 






Outputs 




ii. 


P5C-2 


a 77363 


21. 


SAG-1 




1 


71596 


14. 


SAP— 2 


• 74461 


22. 


SAG- 2 






69780 


9, 


PDC 


f 63928 


19. 


PPIS 






39551 


13. 


SAF-1 


! -40532 


.. 24. 


SAG-4 






36481 


12. 


PSC-3 


39948 


20, 


SPPE 






34252 


18, 


PTE 


j 34509 


23. 


SAG-3 






31332 


17. 


PPE 


! 31394 












16, 


SAF-4 


| 30898 

i 
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model, A review of the variables which load significantly on this factor 
(sec Table 8) , indicated that this factor (a) circumscribed most of ■ the 
qualitative and quantitative elements of Title 1 program expenditures as 
they impact at the school level and (b) contained the seriation of 
components — both as monies and pupil services — which represent systematic 
inputs for controlling specific performance^enabling components which 
effect the achievement outcomes of elementary schools. 

The dynamics of the proposed method for analyzing and quantifying 
the effects of Title I expenditures on elementary schools was revealed 
when the interactive relationships between Factors II and IV were demon- 
strated, Figure 4 shows the Cartesian plot of these coordinate pairs. 

The numbers beside the coordinates identify the respective variables* 

The configuration of points formed by the coordinate pairs seemed to 
suggest that the two factors may be described by two mathematical func- 
tions . 

The linear function contained all of the demographic , traditional 
allocation predictor, per capita, and achievement variables. The parabolic 
function suggested the presence of an allocation condition which is pred- 
icated upon the PDG construct (#9) and its accompanying method for par- 
titioning pupil service components (#10 and #11} and school funding levels 
(#13, #14, and #16), The two supportive service variables of this classi- 
fication (#12 and #15) scheme were noticeably absent. Previous data, 
however, had shown that supportive services did not relate highly with any 
particular variable but acted like a multi-functional element that fitted 
more precisely with those personnel or service areas for which it had been 
programmatically associated (see Appendix A) , 
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FACTOR 

IV 




Figure 4, Cartesian plot of Factor IV and Factor II. 
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should he noted that the tv/o equations are not independent. 
There appears to he at least one solution (functional relationship) for 
the equations r as evidenced by the projected point of intersection 
( x = *81, y = .48), 

The other two minor factors were related (a) to a conglomerate 
expenditure of funds for the improvement of instructional services for 
pupils generally classified as being disadvantaged or from low socio- 
economic environments and (b) to a conglomerate expenditure of funds 
related to the measurement of changes in total school performance in 
reading and arithmetic. 

Factor V, General Disadvantaged Service Expenditure, was an 
expenditure function which related total monies [appropriated from Title I 
program funds (SAF-i) and the general operating budget (PPIS) ] earmarked 
for the improvement of Black (PPC“3) and Spanish surnsmed (PPC—2) pupils 
performance in basic skills. The contribution of PPIS to this service 
was better understood when its relationship with per capita expenditures 
for pupils (r =* ,38) and teachers \r ~ .91) was considered. 

Factor VI, School Investment Outputs, was an expenditure function 
which demonstrated the impact of the general operating budget (PPIS) and 
summative per pupil expenditure inputs (SPPE) on the school’s endeavors 
to improve its propensity to provide continuous pupil growth (SAF-1, 2, 3, 
and 4 ) . 
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Level 2 

Of the six factors identified by the factor analysis procedure. 
Factor II, Program Density Expenditure Functions, appeared to represent a 
reliable construct for describing, defining, and illustrating the func- 
tional components and interrelationships existing between the implementation 
inputs (program policies and practices) of operational management personnel 
and the subsequential achievement outputs of elementary pupils and schools 
served by Title I funds. 



Characteristics of the Program Density Levels 

Since fovir program density levels were inherent in Factor 11, 
inclusive pro j ect— within— density content analyses were performed to 
determine (a_) what kinds of pupil service component projects were available 
^■° schools in each density level, (b) which pupil service component 

projects occurred most frequently within and across the density levels, 
and (_e) whether the patterns of pupil service component projects within 
density levels were related to the observed pupil performance patterns. 

To accomplish this objective, a project implementation matrix was con- 
structed in which all of the projects available to the elementary schools 
were listed — as is shown in Table 9* (p. 36) „ 

Three summary lines of information are provided for each density 
level. The first line gives the number of schools being served by the 
respective projects. For example, in Density #1 there are 13 schools. 

*Schools containing Learning Centers (LC) and Kindergarten Aides (KA) 
were not included in previous counts. Therefore, the total shown is greater 
than the previous listings. However, the aforementioned projects are in- 
cluded here in order to obtain a more reliable estimate of the program input 
characteristics of the density levels. 
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Under the pupil service component category "Instructional Other (IQ), 11 
one observes that throe schools have ASP , two have AT , three have EWA, 
one has IMG , and one has MT * (See Table 2 for an explanation of the 
acronyms. ) 

The second line of information gives the extent to which the 
specified projects occur within the schools of the density level. Using 
the example above, one finds that the percentage of occurrence of the 
projects in the IO category is 23, 15, 23, 8, and 8 respectfully. 

Since the pupil service component projects establish the in- 
structional and programmatic characteristics of each density level, the 
frequency or proportion of times they occur within a density level reflects 
the nature or implementation characteristic (programmatic input) of the 
density level. To summarize and explicate those projects which were most 
indicative of the implementation characteristics of a given density, 
another level of information was developed — implementation ranks, shown 
as the third line of each density level. This ranking procedure entailed 
the listing of the implementation magnitude of pupil service component 
projects (P8CP) within each density level. In Density #1 the ranking was ; 
AEP=EWA>AT-5CC>IMC=KA==LC=MT, which meant (ja) that AEP and EWA occurred the 
same number of times in the schools of the density * level and (b) that both 
projects occurred more frequently than those which follow them. Collectively, 
since the first three positions in the implementation rank order have goals or 
objectives which were directed toward the attainment of cultural and social 
enrichment, it was concluded that the thrust of this density level provides 
for the improvement of a pupil's awareness of his and other's social cultures, 
and an appreciation for the aesthetic qualities of life. Therefore, this 
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Density level was named: 



Educational/Cultural Enrichment Experiences. 



in Density £2 , the implementation information revealed that 
most schools in this Density level had SCC (93%) , KA (71%) , and AT (71-u) • 
Other PSCP occurring at meaningful levels were IMC (36%), AEP (21%) , and 
EIP (21%) , Collectively, the implementation rank order suggested that 
the thrust of this Density level stressed the use of the community (SCC) , 
additional instructional programs (AT, IMC, MT) , and supportive personnel 
(KA, EXP) as its major thrusts for the improvement of pupil performance. 
Therefore, this Density level was named; General Instructional and 
S up e rvisory Support System , 

In Density #3 , the implementation information revealed that most 
schools in this Density level had SCO (100%) , KA (82%) , AT (82%) , and 
IMC (.7 5% ) * Other PSCP occurring at meaningful levels were EIP (57%) , 

CD (50 %) t and ABP (39%) . The emphasis of this Density level was somewhat 
similar to that of the previous model* However , with the increased number 
of BAS projects and the larger proportion of schools having IQ and SUP 
projects t this Density level seemed to provide a more intensive concentra- 
tion on the development of basic skills and human qualities. Collectively 
the implementation rank order suggested that this Density level be named: 
Inten sive Instructional and Supervisory Support System , 

In Density #4 , the implementation information revealed that 
most schools in this Density level had SCC (100%) , KA (93%) , AEP (87%) 
and IMC (73%), Other PSCP occurring at meaningful levels were CD (67%) 
and EIP (67%). In contrast to the other density levels, this Density 
level had a significantly greater number of schools having BAS projects - 
in particular EIP Aides, 



Collectively, the implementation rank order 
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implied that this Density level, having a greater number of projects and 
additional instructional aides in their classroom, emphasized (_a) greater 
project involvement and (b) the individualization of instruction. There- 
fore, this Density level was named: Remediation Program , 

When the implementation rank order pattern over the total 
population of schools v:as reviewed, it appeared that as of June 1970, the 
greater proportion of Title I program funds was invested as supportive 
and instructional services. Investments for the improvement of basic 
skills appeared in two forms s direct projects as BIP (42%) , IRS (9 %) , 
and LC (6%) ; indirect projects as IMC (54%) , CD (36%) , and KA (69%), 

Program Expenditure, Pupil and School Characteristics 
of the Pour Implementation Models 



I mpl omen tat i on Model I: Educational/Cultural Enrichment Experiences 

This level of program expenditure was directed toward the improve^ 
ment of a pupil f s awareness of his own and other social cultures, and an 
appreciation for the aesthetic qualities of life* 

In Model I there are 11 elementary schools. The average school 
enrollment is 732 pupils, 667 (91.1%) of whom attend on a daily basis. 

The school 1 s population generally consists of 49.8% Black, 1.0% Spanish 
surname, 49,2% White, and 20.4% Low Income pupils. There are, on the 
average, 24 teacher staff positions per school* The average amount of 
Title I funds allocated to each school is $6,200 ($2,540 as 10 projects, 
$3,660 as SUP). This SAF total represents an average per pupil expenditure 
of $12.00 and per teacher expenditure of $78.00, The school provides, on 
the average, a growth of 2.4 GE years in reading and 2 . 3 GE years in 
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arithmetic skills over 3 school years of instruction. 



Implementation Model XI t General Instructional and Supervisory Support 
System 

This level of program exx^enditure was directed toward the improve- 
ment of instructional programs at all elementary grades. The thrusts of 
the model are directed toward the use of the community , supervisory 
personnel, and additional instructional programs. 

In Model II there are 11 schools. The average school enrollment 
is 829 pupils, 736 (88.8%) of whom attend on a daily basis. The school’s 
population generally consists of 86.7% Black, 1,2% Spanish surname, 12.1% 
White, and 25,7% Low Income pupils. There are, on the average 27 teacher 
staff positions per school. The average amount of Title I funds allocated 
to each school is $25,900 ($3,500 as BAS* , $8,200 as XO, $14,200 as SUP). 
This SAP total represents an average per pupil expenditure of $44,00 and 
per teacher expenditure of $1,097, The schools provide, on the average, 
a growth of 1,9 GE years in reading and 2,0 GE years in arithmetic skills 
over 3 school years of instruction. 

Implementation Model III; Intensive Instructional and Supervisory Support 
System 

This level of program expenditure was directed toward the improve- 
ment of instructional practices and supervision — ^particularly in the area 
of basic skills. The thrusts of the model take the form of instructional 
aides and supervisors. 

*Vulue obtained by dividing categorical funds by total number of 
schools in Models, 
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In Model III there are 26 schools. The average school enroll- 
ment is 827 pupils, 736 (89.0%) of whom attend on a daily basis. The 

school 1 s population generally consists of 79,8% Blacky S,6% Spanish surname, 
11,6% White, 35,3% Low Income Pupils. There are, on the average, 27 teacher 
staff positions per school. The average amount of Title I funds allocated 
to each school is $38,600 ($13,900 as BAS*, $9,60 0 as 10, $15,100 as SUP) . 
This SAP total represents an average pupil expenditure of $66.00 and per 
teacher expenditure of $1,648, The schools provide, on the average, a 
growth of 1.8 GE years in reading and 1,9 GE years in arithmetic skills 
over 3 school years of instruction, 

I mp 1 cm enfation Model IV: Remediation Programs 

This level of program expenditure was directed toward the estab- 
lishment of permanent basic skill centers and systems which provide the 
pupils with a continuous exposure to (a_) individualized instructions, 

(b) a concentration of new and innovative materials, and (c) an increased 
involvement of school and community support systems. 

In Model IV there are 15 schools. The average school enrollment 
is 979 pupils, 825 (84.3%) of whom attend on a daily basis. The school's 
population generally consists of 85*4% Black, G # 7% Spanish surname, and 
13*8% White, and 47.4% Low Income pupils. There are, on the average, 31 
teacher staff positions per school. The average amount of Title I funds 
allocated to each school is $50,200 ($20,600 as BAS*, $12,500 as 10, 

$17,100 as SUP). This SAP total represents an average per pupil expendi- 
ture of $67.00 and per teacher expenditure of $1,720. The schools provide, 

*Value obtained by dividing categorical funds by total number of 
schools in Models* 
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on the average, a growth of 1.8 GE years in reading, and 2.0 GE years in 
arithmetic skills over 3 school years of instruction. 

A summary of the statistical data across the quantitative 
variables by Implementation Model is given in Table 10. This table shows 
that significant differences between the models exist on the following 
variables ; PFC-1, PPC-3 , AGD-R, (SAF-1) , SAF-2 , SAF-3, SAP-4, PPE, and PTE 

TABLE 10 



Summary of Variable Data by Implementation Model - 



Implementation Model p 



Variable 


I 

<n«ll) 


II 

(n=ll) 


in 

(n=26) 


IV 

(n=15) 


Combined 

(N=63) 


, * a 
Ratio 


1. 


SE 


732 




829 


827 


979 


S47 


1.37 n. s, 


2 . 


ADA 


667 




736 


736 


825 


745 


0,55 n.s 


3 £ 


PPC-1 


149 




213 


292 


464 


294 


5.87* 


4. 


PPC-2 


7 




10 


71 


7 


32 


1,62 n.s 


5. 


PPG- 3 


365 




719 


660 


837 


67 0 


3.43** 


6. 


TS 


24 




27 


27 


31 


28 


1,28 n.s 


7 , 


AGD-R 


2. 


4 b 


1.9 


1.8 


1.8 


1.9 


4.94* 


8. 


AGD-A 


2, 


3 b 


2.0 


1.9 


2.0 


2.0 


2,67 n.s 


13. 


SAF-1 


0 . 


0 d 


(19.2)° 


(20.2) 


(23.8) 


(21.54) 


0.43 n.s 


14. 


SAF-2 


2. 


54 


8.20 


9.60 


12 * 50 


9,40 


7,26* 


15. 


SAF-3 


3. 


66 


14.20 


15.10 


17.10 


15.20 


6,56* 


16. 


ST 4 


6 « 


20 


25.90 


38,60 


50.20 


33.90 


34.88* 


17. 


PPE 


12. 


00® 


44.00 


66.00 


67.00 


53.00 


6,82* 


18. 


PTE 


0, 


28 d 


1.10 


1.65 


1.72 


1.33 


11.20* 


19. 


PPIS 


494. 


00 e 


452.00 


476.00 


456.00 


470,00 


1.05 n.s 


20. 


SPPE 


506. 


00® 


496.00 


541.00 


522.00 


523.00 


0.80 n.s 



a One— way analysis of variance for unequal n's. 

^Grade equivalent years of growth in three school years, 
cyaiues represent a relatively small number, of schools in samples - 
M— 11=2 , M— 111=18, M-IV=13. 

^In thousands of dollars. 
e in dollars . 

*p < * 01 

**p < .05 

Three significant facts concerning the programmatic input of 



Title X funds to meet the needs of elementary school pupils in Philadelphia 




43 



43 



arise from these data. First, there appears to be a direct linear relation 
ship between the number of pupils from low income families and the implemen- 
tation models. Se cond , in this relationship, the per capita expenditures 
for pupils and teachers increases accordingly, as well as simultaneously, 
providing an equivalence in total per capita expenditures across the models 
with respect to other budgetary inputs from operating capital. Third , 
although a significant difference exists between the models in terms of 
aggregate Title I funds (SAF-4), this appropriation is consistent with the 
increasing need for improved pupil performance in basic skills (AGD-R) * 

These relationships are shown graphically in Figure 5. 

Pupil Population Data 

Through a systematic extraction and sorting procedure , * a 20% 
sample of pupils from 63 Title X and 47 non^Title I schools was obtained, 

A total of 6,826 cases was identified — 5,683 Title I and 1,143 non-Title I. 
Each pupil case contained the May 1969 and 1970 ITB5 scores in reading 
comprehension, total arithmetic, and Title I project exposure code (s) * Of 
the 5,683 Title 1 cases, 815 or 14% were incomplete? of non-Title X, 76 
or 7% were incomplete.** Table 11 shows the distribution of the sample by 
grade and model (p. 45) . 

To obtain an estimate of the range and levels of performance 
in reading and arithmetic of the Title X pupils in the total sample, two 
frequency distributions of their May 1970 scores were constructed. These 
distributions are shown in Figure 6, where the median population scores in 

*Pupil History File, 5KYDA5, Division of Administrative and Survey 
Research* 

^'Incomplete means the absence of standardized scores. 
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UNIT OF MEASUREMENT 
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Q PPB (in dollars) 
^ SAP-4 (in $1000s) 
@ PPC-1 (in 100s) 
AGD=R (in GEY) 

^ PTE (in $100s) 



Implementation Model 



Figure 5. Functional relationships between 
Implementation Models and five systematic program 
variables. 
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TABLE 11 

Distribution by liodol and Grade of the 6/828 Pupils 
Involved in the FY 1969-1970 Sample 



Models 



GrauC 


Q a 


1 


2 


3 


4 


Total 


3 


30X 


217 


277 


576 


413 


1784 


4 


295 


215 


248 


555 


355 


1668 


5 


279 


255 


231 


524 


388 


1677 


6 


268 


242 


245 


565 


377 


1697 


Total 


1143 


929 


1001 


2220 


1533 


| 6826 



*Model 0 - Non-Title I elementary schools, 

reading (Md* - 3.2) and arithmetic (Md. = 4,0) are presented. Although a 
"goodness -of- fitness" analysis was not performed, the two distributions 



appear to approximate normal curves, with the greater trailing occurring 
in reading performance. 

To compare the distribution of total pupil performance in Title I 
schools with that of non-Title I schools, individual pupil scores were 
transformed into quartile ranks using the 1966 pupil conversion tables 
provided by the test publisher (ITBS) , Each score was placed within the 
appropriate quartile range according to the grade of the pupil. Finally, 
the frequencies within each quartile were summarised across the grades to 
produce the distributions shown in Figure 7 (p, 47). These distributions 
show that the performance patterns of pupils in Title I and non-Title I 
schools are significantly different. However, the distribution of reading 
and arithmetic scores within the two populations are similar. 
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It should he noted (ad that for non-Title I schools each 
quartile contains about 25% of the pupil population and (b) that for 
Title I schools almost 65% of the pupils placed in the first quartile 
and 7% placed in the fourth quartile. Ostensively, about 21% of pupils 
in both populations placed in the second quartile. 

To determine whether differences between the distribution of 
reading and arithmetic scores across the four implementation models 
identified through the impact analysis procedure existed, individual 
quartile distributions were developed for each model. Figure 8 shows 
these distributions. This figure demonstrates that implementation 
model 1 (M-l) is distinctly different from those of the other Title X 
implementation models (M-2, M— 3 , and M-4) . When M-l was compared with 
the non-Title I schools* (M^O) performance, the major difference between 
them was the percentage of pupils in the first quartile (Q-l) • Like 
comparisons across the other models revealed (a) that the distribution 
curves in reading and arithmetic scores were similar and (b) that the 
majority (69%+) of their pupils were in Q-l. 

Figures 9 and 10, on pages 50 and 51, give the quartile distribu- 
tions for each model by grade* A review of these grade distributions 
revealed (a) that the percent of pupils in Q-l increased from grade to 
grade, (b) that the percent of pupils in Q~3 and Q-4 remained fairly 
constant, and (c) that the percent of pupils in Q-2 decreased, which seemed 
to imply that the pupils at this level tended to become less productive as 
they move from grade to grade*' 

A quantitative analysis was performed to determine whether 
significant differences existed between grades 3 through 6 for each model* 
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Figure 8 * Distribution of the aggregate reading and arithmetic scores 
of the non-Title I (M-0) and Title I (Ml-4) pupil populations. 
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Figure 9* Performance distributions by grade-within-models. 
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The mean scores, standard deviations, and F ratios from the analyses 
of reading and arithmetic scores are given in Tables 12 and 13. The 
analyses of variance showed that pupil performance between the grades 
was significant (p < .001). Perusal of the data indicate that significant 
differences in performance also existed between the models at each grade. 

The mean reading and arithmetic scores of each grade within 
the models were plotted to compare the trend of pupil performance across 
the models. Figures 11 and 12 contain isobars of pupil performance in 
reading and arithmetic. In Figure 11, it was observed that the intervals 
between the mean grade reading scores of pupils in non-Title I schools 
were not equal. The distance between grades 3 to 4 (3,4) was less than 
the distance between grades 4 to 5 (4,5) and 5 to 6 (5,6) ■ However, the 
intervals between the mean grade scores for pupils in M**l were constant. 

In 1-1—3, little difference was noted between 3,4. Nevertheless, the 
intervals 4,5 and 5, 6 were about equal and ten-times as great as 3,4. 

The same kind of visual analysis was made for the arithmetic 
isobars shown in Figure 12 on page 56. This figure shows that the mean 
performance scores in grades 3, 4, and 5 of non— Title I schools, M—l , and 
M-2 were not significantly different. A difference of 0.5 GE points did 
exist between these groups at grade six. 

Having an interest in establishing performance curves for Title I 
pupils in Philadelphia, a series of reading and arithmetic performance 
ogives were developed. Figure 13 presents the reading performance ogives 
for grades 3 through 6, Figure 14 presents the arithmetic ogives. The 
purpose for constructing these ogives was to establish a method for as- 
certaining the relative rank a given individual or mean score would have 
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TABLE 12 



Means, Standard Deviations r and Tests for Significance 
Between School Grade Means in Reading 61 









Grades 






Test for 
Significance 
of Difference 
j Between 

l Grades^ 

i 


School 

Mode] 


Reading 

Performance 

Parameters 


i 

3 


4 


| 1 
I 5 i 


6 


Combined 

Grades 

1 


Non-Ti tic X 


Mean 


i 3.9 | 

i ! 


| 4 .6 

i : 


i 

1 

5.5 j 


i 

: 6.7 


5.2 


F (3 ,1064) “ 174 




Std, Dev. 


j 3.-2 ] 

i j 


I 1,3 

1 


1.6 j 


1.7 


1.8 




Title I 1 


Mean 


| 3.5 


4.3 


s 

5,2 


6,0 


4.8 


F (3,863) = 90 


implemen- 
tation s 

2 


Std, Dev, 


1 1 - 2 


1.5 


1.8 


00 

r-l 


1.8 


Mean 


2 ,9 


3 .4 


4.1 


4.8 


3,8 


F (3,876) “ 88 




Std, Dev- 


1.0 


1.2 


1 * 4 


1.5 


1.5 




3 


Mean 


2 .9 


3,1 


3.9 


4.7 


3,7 


F (3, 1894) = 194 




Std, Dev. 


j 1-0 


1-1 


1,3 


1 . 6 


1 - 5 




! 

Mean j 


i 

| 2.9 


3.2 


3,9 


4,7 


3.7 


p , = 112 


4 


St <5 . Dev . | 


i 1.0 


1.3 


1-3 


1-6 


1.5 


1 (3,1315) 



a Iowa Tests of Basic Skills, May 1970, 

^All F-values are significant beyond the .001 level. 
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TABLE 13 

Means, Standard Deviations, and Tests for Significance 
Between School Grade Means in Arithmetic^ 



j 

1 

i 

j Reading 

School 1 Perform a n c* e 

Model { ParamoterR 


Grades 


Combined 

Grades 


Test for 
Significance 
of Difference 
Between 
Grades^ 


5 i t 

3^41 5 6 

* \ \ 


Non-Titlo I 

Title I 
Iraplcnen- 
tation i 

2 

3 

4 


I » 1 

Mean 1 4.0 : 4*0 j 

\ * j 

S td * Dev „ | 1.0 | 1.1 i 


; \ 
i 5.5 \ 6-7 | 
1.4 I 1.6 j 


5 . 2 

1.6 


F (3,1056) = 1901 


Mean 

S td * Dev. 


i 

3*8 j 
J 1 ,2 i 

L_ J 


1 

4 .7 j 
1.3 I 


r — - . 

! 5.4 f 
! ! 

! 1.5 ■ 
1 ' 


6.2 j 
1.6 ! 


I s- 1 

1 1.6 


p (3,eso) “ 112 


' ! ! 

Mean } 3*8 \ 

1 

StcU Dev. j 1.0 1 
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GRADE EQUIVALENT SCOPE 
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Figure 11. Mean reading performance score (ITB5) 
isobars of the stratified sample. 
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Figure 12, Mean arithmetic performance score 
isobars of the stratified sample. 
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Figure 14. Total population arithmetic performance (ITBS) ogives, May, 1970. 
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in the distribution of probable performance scores. For example, a 
sixth-grade pupil having a score of 4.5 in reading would be performing 
the* 4 9 i:ii oer centric or as an average sixth— grade pupil in a Title I 
school. h sixth-grade pupil having a score of 6.5 would be at the 81st 
percentile or a high- performing Title I pupil. Such comparisons could 
lead to a more effective means for comparing the performance of Title I 
pupils with respect to program inputs and school characteristics. 

These ogives v. r ould also permit the classification of Title I 
pupils v:ithin a given grade or at particular schools. For example, if 
a third— grade class in a given school had a range of scores from 2.5 to 
3.5, this class would consist of Title I pupils who exhibit the normal 
range of performance for third— grade classes— —that is pupils who fail 
between Q2 and 03 {50th to 76th percentiles) . 

Program Input/Pupil Output Characteristics 

To ascertain whether the program inputs of the respective 
models were effecting systematic changes in pupil outputs and to deter- 
mine whether the outputs observed from each model differed significantly , 
the previous data were combined to produce a series of Program Input/ 

Pupil Output (PI/PO) schemata as is shown in Figure 15. 

Model 1 

Reading. This figure is the PI/PO schema for M-l in reading 
comprehension. The figure contains (a) the mean grade-within model scores 
in reading for grades 3 to 6 , (b) the difference between the mean grade- 

within model score and the national norm — see parentheses , (c) the 
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Figure 15. Model l's program inputs for improved pupil outputs in reading achievement 
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distribution of pupil scores at three quartiles — Qi , Qg, and Q3-Q4, 
located in the rectangle, (d) the kinds and levels of Title I program 
incuts each oracle rcccivca, ( e ) the mean amounts or total a no. categorical 
monies allocated to the model, (f_) the total and mean gains the average 
pupil attained at the end of each grade. 

Those data showed that the average pupil in grade 3 is 0.3 GE 
below the national norm. It appeared as if this deficiency continued at 
a rate of 0.17 GE/year over grades 4 to 6 , thereby, producing a cumulative 
loss of 0.8 GE at the end of grade G. Second , fin data indicated th 
(a) the proportion of pupils at or above the 50th national percentile 
(Q 3 -Q 4 ) decreased by 9 % over the grades and (h) that an increase of 11 % 
occurred in the number of pupils scoring at or below the 25th national 
percentile (Qg) . These within the 26-49th national percentile (Qg) varied 
by 1 . 8 %. 

Third, a constant investment in IO and SUP pupil service 
components (PSCs) was provided for all grades. Fourth , the average 
amounts of monies spent for the PSC projects were; $2,540 for 10 and 
$3,660 for SUP . Fifth, the pupil output summary showed (aj that the 
average sixth-grade pupil was 0.8 GE behind in reading and (b_) that the 
combined investments produced a total gain of 2.5 GEY over the three 
grades or an average gain of 0.8 GE per school year* However, 33% (287) 

of the sixth-grade pupils were at or above the national norm. 

Arithmetic . In Figure 16, the system for reporting grade 
performance in reading is repeated for arithmetic performance. Changes 
in the proportion of pupils at Q 3 -Q 4 decreased by 14%. The proportion 
of pupils in Q 2 increased by 9%. Those in Qq increased by 5%. 
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igure 16. Model l r s program inputs for improved pupil outputs in arithmetic achievement-. 
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assignment of TSC projects to the grades remained the same. Although the 
droo in pupil performance below national expectation occurred at the end 
of grade 5, the total gain over the three grades was 2.4 GEY or 0.8 GE 
per school year. However, 36% (306) of the sixth-grade pupils were at 
or above the national norm. 

School achd ev oment control strategy . According to the classi- 
fication of Title I project content variables which control school variance- 
shown in Table 1, the combination of 1(3 + SUP (Bloom’s variables =2+3) 
suggested a systematic input system for controlling the affective aspects 
of education by improving the teacher's capability to understand and 
utilize changes in pupil attitudes (self —perception) as a means for 
motivating the pupils to perform at their rjotential. Since these pupils 
v/ere almost performing at national expectation , an inherent assurnp». ion of 
this model seemed to be that its schools have formulated instructional 
programs which meet the needs of the majority of its pupils. 

Model 2 

R eading . In Figure 17, the data indicate that the average 
third-grade pupil completed the year with a reading score of 2.9, which 
is 0.9 GE below the national norm. This deficiency increased to 2.0 GE 
at grade 6 . The proportion of pupils in Q 3 -Q 4 dropped from 19% at grade 3 
to 12% at grade 6 , a loss of 7%. Increased proportion of pupils appeared 
in Q lf from 66 % in grade 3 to 75% in grade 6 . The number and kinds of 
PSCs provided to the grades increased across the grades from a minimum 
of two at grade 3 to a maximum of five at grade 6 . BAS projects occurred 
from grade 4 through 6 . The average amounts of monies spent for the PSCs 
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Figure 17. Model 2's program inputs for improved pupil outputs in reading achievement 
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eio. y 3 / - 02 . i ^<3,20j for : j , $14,206 for SUP, Tho pupil out out 

summary shc::ci (a_) that the average sixth-grade pupil was behind 2 . 0 G£ 
in reading and (h) that the combined in vestments produced a total gain cf 
1.9 GE V over tho throe grades or 0.6 GE per year, ihvcvcr, 12% (105) of 
tho si;: t;- x - grade pupils were at or above the national norm 

Arithm eti c , In Figure 18, the data indicate that the average 
third-grade pupil. completed the grade with an arithmetic score of 3 . 2 , 
v?hi ch is 0.6 GE below the national norm. This deficiency increased to a 
loss of 1.8 GE at grade 6 . The proportion of pupils in Q 3 -Q 4 dropped by 
17% across the grades. A slight fluctuation of + 3% occurred in Q 2 7 s 
proportions * A gain of 17% occurred across the grades in Q 7 . The PSCs 
available to the grades produced a mean gain of 1.8 GEY across the grades 
or a gain of 0.6 GE in arithmetic. However, 10% (84) of the sixth-grade 
pupils v T ere at or above the national norm 

School achi e vement control strategy . The configuration of 
PSCs within this model indicated that its systematic input system was 
diiected toward controlling all factors which influence pupil performance 
(BAS + 10 + SUP) . The amounts of monies spent for the PSCs suggested that 
the heaviest emphasis was achieved through additional supportive materials 
and personnel. When compared to the previous model, the changes in expendi- 
tures for SUP ($10,540) was about two times as much for IO_ ($5,600), which' 
was accompanied by an increase of $3,500 for BAS . The objective of this 
expenditure was to improve the capacity of its teachers to diagnose and 
manage classroom instructions. Cognizance was made of the pupil* s needs 

additional assistance in basic shill development (BAS) . Likewise were 
monies available to improve the affective aspects of the pupil 8 s education 
(SUP) . 
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Figure 18. Model 2's program inputs for improved pupil outputs in arithmetic achievement. 
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Model 3 

Rea ding . In Figure 19, the data indicate that the average 
third-grade pupil completed the year with a reading score of 2 . 9 , which 
is 0,9 GE below the national norm. This deficiency increased to 2.1 GE 
at grade 6 . The proportion of pupils in decreased from 17% at 

grade 3 to 12% at grade 6 - At O 2 the percentage of pupils fluctuated 
across the grades, but ended up at 11% in grade 6 . The proportions in 
increased to a high of 81% at grade 4 and decreased to 77% at grade 6 . 

The rise in the proportion of pupils in Q 2 -Q 4 , as well as the drop in Q lt 
appeared to be attributed to the additional BAS projects placed in grades 
4 to 6 , The number and kinds of PSCs ranged from a minimum of three at 
grade 3 to a maximum of six over grades 4 to 6 . The average amounts of 
monies spent for the PSCs were: $13,900 for BAS , $9,600 for IO, and 

$15,100 for SUP . The pupil output summary showed (a) that the average 
sixth-grade pupil was h r '' ‘ 7.1 GE in reading and (lb) that the 

combined investments jotal gain of 1.8 GEY over the three 

grades or 0.6 GE per year. However, 12% (218) of the sixth-grade pupils 

were at or above the national norm. 

Arithmetic . In Figure 20, the data indicate that the average 
third-grade pupil completed the grade with an arithmetic score of 3.1, 
which is 0.7 GE below the national norm. This deficiency increases to 
a loss of 1.8 GE at grade 6 . The proportion of pupils in Q 3 -Q 4 dropped 
by 15% across the grades. The proportion of pupils in Q 2 remained stable 
except at graue 4 where the amount increased to 17%. At Q 1 the proportions 
increased to a. maximum of 78% at grade 6 , The PSCs available to the grades 
produced a mean gain of 1.9 GEY across the grades or a gain of 0.6 GE per 
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Model 3’s program inputs for improved pupil outputs in reading achievement. 
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Figure 20. Model 3.’ s program inputs for improved pupil outputs in arithmetic achievement 
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year. The average sixth-grade pupil was behind 1.8 GE in arithmetic. 
However, 13% (236) of the sixth-grade pupils were at or above the national 

norm . 

School achievement control strategy . The conf iguration of 
PSCs within this model indicated that its systematic input system was 
directed toward controlling all factors which influence pupil perform- 
ance (BAS + 10 + SUP) . in contrast to the amounts of money spent for 
PSCs in the previous model, the expenditures for 1(3 and SUP remained 
about the same (0.8V), whereas the increase for BAS was threefold. This 
expenditure pattern seemed to imply that although there existed a major 
investment for supportive materials and personnel, the focus of the 
additions was tov:ard improving the teacher 1 £ ility to teach the basic 
skills. To assist in the management of basic kill instruction, a larger 
proportion of the schools in the model received instructional aides. 



Model 4 

Reading . In Figure 21 (p. 71) , the data indicate that the 

t 

average third-grade pupil completed the year with a reading score of 2.9 
GE, which is 0.9 GE below the national norm. This deficiency increased 
to 2.1 GE at grade 6 . The proportion of pupils in Q 3 -Q 4 decreased from 
20% at grade 3 to 12% at grade 6 . At Q 2 the percentage of pupils decreased 
consistently across the grades to a level of 8 % at grade 6 . The propor- 
tions in Qj increased from a low of 59% to a high of 80% in grade 6 . The 
number and kinds of PSCs ranged from a minimum of. four at grade 3 to a 
maximum of eight at grade 6 . The average amounts of monies spent for the 
PSCs were: $20,600 for BAS , $12,500 for IO, and $17,100 for SUP . The 
pupil output summary showed (a_) that the average, sixth-grade pupii was 
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Figure 21. Model 4's program inputs for improved pupil outputs in reading achievement 
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behind by 2 . 1 



in reading and (b_) that the combined investments produced 



a tore 1 gain of 1.2 GUY over the three grades or 0.6 GE per year. However, 
12 p o (167 j of the sixth-grade pupils were at or above the national norm. 

Arith metic . In Figure 22, the data indicate that the average 
third-grade pupil completed the grade with an arithmetic score of 3.0 GE, 
which is 0*8 GE below the national norm. This deficiency increased to 
2.8 GE at grade 6 . The proportion of pupils in S 3 -Q 4 dropped by 12% 
across the grades. The proportion of pupils in £>2 fluctuated by ± 3%, 
ending up at its average value of 12%. At the proportions increase 
systematically to a level of 76% at grade 6 . The PSCs available to the 
grades r^oduced a mean gain of 3.0 GEY across the grades or a gain of 0.7 
GE per year. The average sixth-grade pupil was behind by 1.8 GU in arith- 
metic. However, 12% (153) of the sixl. . grade pupils were at or above the 
national norm. 

School achievement control strategy . The configuration of 
PSCs within this model indicated that its systematic input system was 
directed toward controlling all factors which influence pupil performance 
(BAS + 10 + SUP) . In contrast to the amounts of money ..ox , ,cs in 

the previous model, the changes in expenditures formed a geometric 
progression: 13% for SUP , 30% for 10, and 48% for BAS . When SUP was 

considered as the basal increase ( SUP = 1), the ratios of increase became 
SUP = 1, 10 — 2.3, BAS — 4.6 respectfully. When the amounts of money spent 
for PSCs were compared across Models 2 through 4, it was noted that the 
increased spendings for IQ and SUP projects formed a pattern — the increases 
from Model 3 to 4 were twice those from 2 to 3. For BAS projects, the 
absolute amount allocated to Model 2 increased by threefold in Model 3 and 
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Figure 22. Model 4's program inputs for improved pupil outputs in arithmetic performance 
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by twofold in Model 4. 

The decremontal changes in expenditure patterns suggested that 
this model represented the mnxixni nation of instructional inputs for the 
improvement of the basic shills, as witnessed by the high level of spend- 
ing for E As projects ($20,600)- The high level of BAS expenditure permitted 
the establishment of five Reading Skill Centers where the reading dis- 
abilities of the children are diagnosed and individual , corrective programs 
are prescribed. The collective expenditures for BAS and SUP also afforded 
the availability of individualized instruction in reading and arithmetic 
in the classroom. 



DISCUSSION 

As stated earlier (p. 13) , the major purpose for developing the 
impact component analysis technique was to provide oj^erational management 
with information about the feasibility and viability of the program (in- 
structional) configurations their implementation decisions had produced. 

The need for such information was demonstrated in the hierarchial decision- 
making and reporting structure shown in Figure 1. It was noted that opera- 
tional management are those persons who are responsible for translating 
strategic plans into operational units (projects) that assist instructional 
management (i.e., teachers, principals) in improving the achievement of 
the pupils in the target population. 

The technique was designed to provide four kinds of inf ormation . 
The four specific output objectives were : 

1. To identify and describe the implementation patterns 
within the 63 elementary schools? 
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2, To ascertain whether the impact components of the emerg- 
ing implementation pattern are consistent with the nceds-asscss- 
nie 2 'it of the pupil populations they v:ere designed to serve; 

3- To produce, service-cost information which relates imple- 
mentation inputs to anticipated and/or attained pupil and school 
ou Lputs ; and 

4- To provide operational management with a number of 
alternative procedures for narrowing the discrepancy between 
desired pupil outputs and systematic xerogram inputs * 

A brief response to each of the four output objectives follows. 

Imp! one n tati on_ Mod e Is: P at ter ns 

The results of the evaluation of the investment of Title I pro- 
jects in 63 elementary schools indicated that there exists within the school 
district four Title I Inrplementati on Models, These models seemed to have 
evolved (<\) from the decisions of operational management in its responsi- 
bility for translating the policies of strategic management into implemen- 
tation practices and (b) from the assessed needs of the pupil populations 
being served by the 63 elementary schools. The configuration of instruc- 
tional inputs ranged from the consideration of basic experiences to improve 
one's self-imago (affective variables) to the articulation of specific 
corrective feedback loops to meet the individual needs of the children 
[during the learning of reading and arithmetic skills (cognitive vari- 
ables.) ] The prescriptive treatment sets (pupil service components) assigned 
to the implementation models were those which could, according to Bloom's 
partition of school achievement variance, systematically improve pupil 
performance . 
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Imp 1 o r.en t a ti on Ko dols: rupees -Assessment Quality 

The results of impact component analysis indicated that the plan- 
ning strategics and allocation procedures used by operational management 
were successful in that: 

Each of the four implementation models v:as designed to meet 
the needs a specific subset of pupils within the aggregate target popu- 
lation; 

The number and kinds of projects made available to the respec- 
tive schools provided pupil service components which would systematically 
control achievement variance; 

. The realized funds available to the school s (school aggregate 
funds) were allocated in a manner such that the greater proportions of monies 
were available to those schools having the greatest needs; 

# The realized per capita expenditures for pupils and teachers 
within tlie designated models increased as a function of the pupil needs in 
the corresponding peculation, which represents an effort to recognize and 
implement the concentration principle ; 

# As the number of pupils from low income families increased, 
the level of per capita and total school expenditures increased proportion- 
ally, which represents an effort to meet the criteria for program c ompara- 
bility j 

. A technique for establishing program accountability measures 
and identifying effective program delivery systems for disadvantaged children 
was developed. 

Implementation Models: Service-Cost Information 

Preliminary results suggested that (a) although the allocation 
patterns derived through the placement of Title I projects were consistent 
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v;ith th^ rpcJ:. of the perils and (b) although the reliability of the expen - 
^ ^ -c/- rr.-'^c^.rations were corroborated , it appeared that the 

nr r.j-oncrtiO!::' of monies spent for the PSCs within the models were not 
pr.oducir.rr the err., c ted levels of pupil performance . If one had proposed 
the expenditures to place Title I pupils at their appropriate grade-level 
performance, then the expenditure objective was partially attained in 
Model 1 — an attainment range of 33-50%. If one had proposed the expendi- 
tures to minimize the proportion of Title I pupils who place in the first 
quartile (Qq) , then only Model 1 (X=44%) partially achieved the objective, 

whereas the other models did not (viz., £ 66% of their pupils placed in 

q-^) . If one had proposed the expenditures to produce a uniform growth 
pattern of one performance-achievement year between the grades within a 
school, then the expenditure objective was partially fulfilled in Model 1 
(X=o.8 GE/year) ; the value of the other models was approximately 0.65 GE 

per year. 

The distribution of the average PSC expenditures within the 
implementation models are shown in Table 14 . 

TABLE 14 



Distribution of Pupil Service Component (PSC) Expenditures 





Implementation Model 




PSC 

Cate- 

gory 


Educational- 
Cultural 
Enrichment 
Experiences 
(M— 1) 


General 
Instructional 
and Super- 
visory Sup- 
port System 
(M-2) 


Intensive 
Ins tructional 
and Super- 
visory Sup- 
port System 
(M-3) 


Remediation 

Programs 

(M-4) 


BAS 

10 

SUP 


41. 0 a 
59.0 


13.5 

31.7 

54.8 


36.0 
24.9 

39.1 


41 .0 
24.9 

34.1 


Total 


[ 100.0 


100.0 


100.0 


100.0 



^Percent of model's total. 



O 

ERIC 



78 



78 

Tirol er. e n t a t i o r. I lo c cl s : A 1 1 o r na ti ve Input Procedures 

Analyses of the previous findings indicafe that although opera- 
tional ranneement had organized, through its project allocation procedures, 
four programmatic rode Is for delivering appropriate (need-assessed) Title 
I resources to disadvantaged elementary school children, the current v.i thin- 
model expenditures fox PSCs are not producing the desired levels of pupil 
performance. It v;ould appear from these data and findings that at least 
six (6) procedural alternatives could jg instituted to reduce the discre- 
pancy between the programmatic inputs and desired pupil outputs. 

Alternative #1. Redistribute the levels of PSC expenditures within 
each model . 

This procedure assumes that the current implementation models 
have p roqrar ana tic (thematic) inputs which are consistent with the needs 
of each pupil population, but that the level of funds allocated within 
the models for the respective PSCs are disproportionate to the required 
services. For example, past evaluations of the Reading Skill Center (RSC) 
project* have demonstrated that RSC improve the- reading ability of Title I 
pupils; however, 2 of the 28 schools in M— 3 have RSC, and 4 of 15 in M— 4 
(see Table 9, p. 36). The reallocation procedure in this case would be 
to reduce the level of expenditures for 10 and SUP project inputs and to 
increase the expenditure for BAS projects by adding more RSCs . 

This procedure also implies that although the appropriate com- 
bination of programmatic inputs have been assembled, no logical method 
for ascertaining the functional relationships between the permutations of 
within-model expenditure patterns and desired pupil outputs was available 
because of the absence of impact component data. 

* improvement of Reading Skills (IRS) 



o 




79 



79 



7Q term " tive f:2. Retain PS C configurations, but increase/ by a constant 
factor, the absolute quantity of monies within and across each imple- 
mentation model. 

This procedure is realized by an increase in the total alloca- 
tion of Title I funds to the School District by a corrective ratio that is 
equivalent to the total derived from the summations across the implsmen- 
ta ti o n mod els. 

Alterna tive #3. Retain present school aggregate fund (SAP) levels, 
but perrn.it the staff, parents, and community of the schools to choose 
from the list of 16 projects a commensurate project configuration 
they feel will assist them in attaining their needs and/or goals* 

This procedure is predicated upon the current concerns for 
decentralization and community involvement in Federal Programs. Given 
that the aforementioned persons and institutions have the capability to 
diagnose, formulate, and initiate instructional programs that meet their 
collective needs and/or goals, this comprehensive group selects from the 
"shopping list," of available Title I project components that number of 
units which is equivalent to its school* s aggregate fund (SAF) . Basic 
information about each Title I project's objectives, materials, method- 
ology, and outcomes would be available to the purchasers of Title I pro- 
gram services. 

Alternative #4 . Modify or replace Title I project components. 

This procedure assumes that a specific Title X project compo- 
nent is not meeting its individual objectives and should, therefore, be 
modified or replaced by another variation/component. 

Alternative #5 . Reconstruct the implementation models. 

This procedure assumes that the current implementation models 
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are not valid and/or not consistent with the needs of the target population. 
Therefore , a massive redistribution of the project components is made among 
the. schools. Subsequently , a 2 i impact component analysis is performed to 
ascertain whether the newly constructed implementation patterns were more 
productive than the former. 

Alternative #6. Modify or change strategic and operational goals 
and objectives* 

This procedure is essentially a "back to the drawing board 
decision. The procedure entails the total reconstruction of the policies 
and thrusts of both management levels. The final outcome of this delibera- 
tion is envisioned as a new stance or position relative to the allocation, 
acceptance, or uses of Title I funds within the school district. 

CONCLUSIONS 

The findings of this study indicate that the methods, procedures, 
and techniques used to measure or assess the impact of ESEA, Title I program 
funds on urban elementary schools and their pupils need to be reconsidered. 
One major assumption upon which current evaluation methods and procedures 
are based is that the school populations being served by Title I funds are 
homogeneous with respect to their (ci) ethnic composition, (bj individual 
and collective needs, and (c) achievement characteristics. Another 
assumption, which tends to be inherent in or an outgrowth of the former, 
is that the best measure for ascertaining an effective level of pupil 
service delivery is a per capita (pupil) cost index. 

Three salient factors arise from this study which indicate (a.) 
that the previous assumptions are incorrect, (b) that rational patterns 
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of Title X program component inputs exist within urban elementary schools, 
and (c) that new procedures and indices must be established if one is 
expected to improve the reported discrepancy between Title I program inputs 
and their subsequent pupil outputs. 

First , the schools in the target population being served by 
Title I fu nds are not homogeneous w ith respect to their ethnic composition , 
needs , and achi evem ent characteristics . All indications are that v;hen the 
conglomerate of schools and their pupils are surveyed/assessed on a given 
achievement or social variable collectively, the computed mean or median 
obtained from these data show the traditional performance patterns of 
Title I schools (see Figure 6) , and not the dynamic within-and between- 
school differences. This is especially true if the schools within the 
target population have a variety of unique program inputs sets, as was 
shown in this study by operational management 1 s allocation of Title I 
program funds according to a needs-assessment criterion. 

However, until the impact component analysis technique was 
developed and used, the reliability of these seemingly intuitive judgments 
could not be ascertained. As the results show, the needs-assessment 
criterion procedures of operational management produced four unique 
implementation models. Each model, described on pages 39-42, has demo- 
graphic, expenditure levels, needs-assessment characteristics, and program 
component inputs that are significantly different. Even the program 
component inputs — pupil service components (PSC) — represented program 
treatment conditions that were analogous to the systematic variables 
Bloom described as being capable of controlling up to 90% of school achieve- 
ment variance (see Table 1). 
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seq uent ; u p i 1 ou t n u t s . As is evidenced by the six procedural alternatives 
proposed to improve the pupil outputs of the implementation models (see 
pp. 78-80) , operational management needs to have an opportunity to modify 
and/or restructure the implementation practices they have instituted 
from pact information. Since they have had . _ opportunity to reallocate 

and modify individual projects within a school setting to produce projects 
that yield successful outcomes, so must they be able to reallocate the 
PSCs within the defined implementation model to discover which permutation 
of PSC produces the treatment control conditions discovered by Bloom. 

Moreover, when one considers the school to be the unit of cost 
accountability, it appears as if one could discover that configuration 
and level of pupil services which lead to the maximization of a school's 
potential to improve the achievement of disadvantaged pupils. This assump- 
tion appears to be tenable in that, not only were school expenditure 
densities (PDC) a significant contributor to Factor II, but they were 
also evidenced in Factor IV (Direct Pupil Service Components) , Factor III 
(School Achievement Measurement), and Factor VI, (School Investment 
Outputs). Collectively, these factors seem to imply that Title I schools 
should become the accountability units of financial/cost inputs and pupil 
outputs . 

To ascertain the effectiveness of the modifications mentioned 
above, new methods must be used to determine whether these revised pro- 
cedures produce more successful outcomes. Instead of using a contemporary 
technique for evaluating the impact of the implementation models, the 
evaluator must reexamine each model to ascertain which dependent variables 
are being affected by the thrusts of the implementation models. As in the 
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case of I*:-l mentioned in this study, the evaluation design would be con- 
cerned with determining whether investments in educational/cultural 
experiences produce an increase motivation for learning — operationally 
defined as an improved attitude toward school and the learning process. 

A statistic of choice might be (a_) the analysis of covariance or (Id) 
the use of the Spearman Rho technique to determine whether cianges in 
attitudes were significantly related to imiDroved performance in reading 
and arithmetic. In addition, a general content embedded test, consisting 
of face-valid items, could be developed whereon a specified criterion 
score v;ould represent a measurable increase in one’s knowledge of his 
and other’s culture (viz., World Affairs Clulh . 

In summary, the findings of this study seem to indicate that 

(1) systematic patterns of pupil service needs exist within 
Title I target populations, 

(2) LEA’s operational management employ a needs-assessment 
criterion in the allocation of Title I program funds, 

(3) Title I program implementation models exist within a 
LEA 1 s district such that the between model allocations are a function of 
school and pupil needs, 

(4) investment of Title I funds are producing a positive 
differential effect on school and pupil achievement, 

(5) pupil outputs from Title I investments can be maximized, 

(6) a method for ascertaining the relationship between the 
impact of program implementation strategies and pupil outputs has been 
introduced, and 

(7) a new method for assessing the impact of Title I program 
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funds on urn an element ary schools has been developed for improving the 
procedure and/oj* processes for reallocating the program funds to realize 
b i cr] i c- i" levels o£ pupil pai:f ornianco . 
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Intercorrelation Matrix of 24 Variables Associated with Programmatic Input 
Demographic Characteristics, and School Output for ESC A, 
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